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(54) Abstract Title: Processing digital media streams 

(57) A digital processing device (10) to process media data is provided. The device (10) includes a plurality of 
processing modules to process the media data, and a media data path (22). The media data path (22) 
communicates the media data between the processing modules, wherein the media data path (22) is 
arranged in a ring configuration. In one embodiment, the media data path (22) defines a digital audio bus 
that serially interconnects the plurality of processing modules. The digital audio bus may communicate 
digital audio data in a plurality of time-slots, each particular processing module having an associated 
time-slot from which data is received from the data path for processing by the particular processing 
module. The system may use a time division multiplexed (TDM) bus. The data may be communicated at 
different bit rates. A data control path may communicate control data to the modules, including 
parameters for digital signal processing such as filter or mixing parameters. 
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METHOD AND DEVICE TO PROCESS DIGITAL MEDIA STREAMS 



FIELD OF THE INVENTION 

5 

[0001] The present invention relates generally to the field of processing 
digital media data. More specifically, the invention relates to a method to 
communicate media data between a plurality of processing modules and to 
a digital processing device to process media data. 
1 0 [0002] The present application claims priority from USSN 10/636 087, 
which is incorporated in its entirety herein by reference. 



BACKGROUND OF THE INVENTION 



15 [0003] Conventional audio processing devices use a fixed and 

predetermined (hardwired) configuration to interconnect various processing 
components such as filter components, delay components, sample rate 
converters (SRC), and a Digital Signal Processor (DSP). However, such a 
configuration may result in the inability to perform certain algorithms that 

20 require connecting the processing components in a different fashion than the 
hardwired configuration allows. It may also create communication 
"bottlenecks" as the various processing components can only communicate 
with each other via the DSP, if they can communicate at all. The DSP thus 
functions as a hub through which all data is communicated even if the DSP 

25 is not required to process the data. Additionally, a hardwired configuration 
often results in wasted processing power, since a signal always passes 
through a particular processing component even if the algorithm does not 
require that component. And if an algorithm requires more processing 



1 



elements than the hardwired configuration provides, the algorithm cannot 
be performed. It will thus be appreciated that such a configuration may 
inhibit device performance. 



5 SUMMARY OF THE INVENTION 



[0004] In accordance with the invention, there is provided a digital 
processing device and method to process media data, the device including 
a plurality of processing modules to process the media data; and 

10 a data path to communicate data between the processing modules, 
wherein the data path is arranged in a ring configuration. 

[0005] The invention extends to a machine-readable medium embodying 
a sequence of instructions that, when executed by a machine, cause the 
machine to carry out any of the methods described herein. 

15 The invention also provides a computer program and a computer 
program product for carrying out any of the methods described herein 
and/or for embodying any of the apparatus features described herein, and a 
computer readable medium having stored thereon a program for carrying 
out any of the methods described herein and/or for embodying any of the 

20 apparatus features described herein. 

The invention also provides a signal embodying a computer program for 
carrying out any of the methods described herein and /or for embodying 
any of the apparatus features described herein, a method of transmitting 
such a signal, and a computer product having an operating system which 

25 supports a computer program for carrying out any of the methods described 
herein and /or for embodying any of the apparatus features described 
herein. 
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The invention extends to methods and/or apparatus substantially as 
herein described with reference to the accompanying drawings. 

Any feature in one aspect of the invention may be applied to other 
aspects of the invention, in any appropriate combination. In particular, 
5 method aspects may be applied to apparatus aspects, and vice versa. 

Furthermore, features implemented in hardware may generally be 
implemented in software, and vice versa. Any reference to software and 
hardware features herein should be construed accordingly. 

Further features of the invention are characterised by the dependant 
10 claims. 

10006] Other features of the present invention will be apparent from the 
accompanying drawings and from the detailed description that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 

10007] The invention is now described, by way of example, with 
reference to the accompanying diagrammatic drawings. In the drawings, 

Figure 1 shows a schematic block diagram of an exemplary digital 
20 processing device, in accordance with one embodiment of the invention, 
including a data path arranged in a ring configuration; 

Figure 2 shows a schematic block diagram of a further embodiment of 
a digital processing device, also in accordance with the invention; 

25 

Figure 3 shows a schematic block diagram of a routing controller, in 
accordance with an embodiment of the invention, for routing digital data in 
the digital processing device of Figure 2; 
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Figure 4 shows a schematic block diagram of an exemplary interface 
between a routing controller and a digital signal processor (DSP) of the 
digital processing device; 

5 

Figure 5 shows a schematic block diagram of a processing module 
interface, according to an embodiment of the invention; 

Figure 6 shows an exemplary time-slot location arrangement of the 
10 data path of Figure 2; 

Figure 7 shows an exemplary linked list of an input mapper; and 

Figure 8 shows a schematic flow diagram of a method, in accordance 
15 with the invention, for communicating data in a digital processing device. 

DETAILED DESCRIPTION 

[0008] A method and device to process digital media data, is described. 

20 In the following description, for purposes of explanation, numerous specific 
details are set forth in order to provide a thorough understanding of the 
present invention. It will be evident, however, to one skilled in the art that 
the present invention may be practiced without these specific details. 
[0009] Referring to the drawings, reference numeral 10 generally 

25 indicates a schematic block diagram of an exemplary digital processing 

device in accordance with the invention. The device 10 is shown to include a 
plurality of processing modules, namely, a digital signal processing (DSP) 
module 12, a delay module 14, a sample rate converter (SRC) module 16, a 
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filter module 18, and a mixer module 20. The modules 12 to 20 are 
interconnected serially via a data path 22 which is arranged in a ring 
configuration wherein data is sequentially communicated from any one 
processing module to any other processing module. Unlike conventional 
5 digital processing devices, the device 10 in accordance to the invention 

allows each module 12 to 20 to communicate data with any other module 12 
to 20 connected to the data path 22 as described in more detail below. In one 
embodiment of the invention, the data path 22 is time division multiplexed 
wherein a routing controller controls communication of data between the 
10 various modules 12 to 20. Further, it is to be appreciated, that the modules 
12 to 20 are merely exemplary modules and further modules (with the same 
or differing processing capabilities) may be included in the device 10 and/or 
any one or more of the modules 20 may be removed and, for example, 
included within any other module 12 to 20. 
15 [0010] Thus, in one embodiment, any one of the modules 12 to 20 may 
communicate data to any one or more of the other modules 12 to 20 under 
control of a routing controller. Accordingly, data being processed by the 
digital processing device 10 may be flexibly routed between different 
modules 12 to 20 and need be not restricted to predetermined pathways as 
20 in the case of conventional devices. It will be appreciated that a module 12 to 
20 and 34 may also communicate data back to itself via the audio bus 46. 
Accordingly, repeated processing may be performed on the data by the 
same processing module. The processing module 12 to 20 that provides the 
data to the data path 22 may be viewed as a source processing module, and 
25 the particular processing module 12 to 22 that is to process the data may be 
viewed as a target or destination processing module. As a processing 
module 12 to 20 may return processed data to itself, in one mode of 
operation a processing module 12 to 20 may define both the source and 



destination processing module. Thus, for example, the filter module 18 may 
form a cascaded filter arrangement where its output or processed data may 
be sent back to itself for further processing prior to being sent to another 
processing module 12 to 20 and 34. 
5 [0011] Although, the invention is described with reference to processing 
a digital media stream in the form of a digital audio stream, it is however to 
be appreciated that the invention may be applied to the processing of any 
other digital media streams, for example, digital video streams or the like. 
[0012] Referring in particular to Figure 2 of the drawings, reference 

10 numeral 30 generally indicates a digital processing device in accordance 
with a further embodiment of the invention. The device 30 resembles the 
device 10 and, accordingly, like reference numerals have been used to 
indicate the same or similar feature unless otherwise indicated. 

[0013] The device 30 includes a DSP module 12, a delay module 14, a 

15 sample rate converter (SRC) module 16, a filter module 18, and a mixer 
module 20 that are substantially similar to the modules described herein 
before. Further, the device 30 includes an audio memory transport module 
32 and a digital audio input output (I/O) module 34. The audio memory 
transport module 32 communicates via a bus 36 with an interface module 38 

20 which, for example, may form part of a bus of a computer device (for 
example a personal computer or PC). In one embodiment, the interface 
module 38 includes a bridge 40 and two PCI-X bus interfaces 42 that 
interface the bridge 40 to a conventional PC bus 44. The digital I/O module 
34 may receive a digital audio input and provide digital audio output to an 

25 output device. As in the case of the device 10, the device 30 includes a data 
path 22 which serially interconnects the modules 12, 34, 32 and 14 to 20. 

[0014] The data path 22 of the device 30 includes a media data path in the 
exemplary form of an audio data path or audio bus 46, and a processing 
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control path in the exemplary form of a parameter bus 48. In one 
embodiment, both the audio bus 46 and the parameter bus 48 are arranged 
in a ring configuration wherein data is communicated between the various 
processing modules 12 to 20, 32, 34 in a time division multiplexed fashion. 
5 As the various modules are located along the audio bus 46, audio data may 
be routed between modules without requiring the data to be routed through 
a central hub (e.g., a DSP). In certain embodiments, the device 30 includes a 
transport bus 50 which interfaces an external computer via the interface 
module 38 and the audio memory transport module 32 to the processing 

10 modules 12 to 20. 

[0015] In order to control the routing of data on the data path 22 
(including, for example, the audio bus 46, the parameter bus 48 and the 
transport bus 50) the device 30, in certain embodiments, includes a routing 
controller 52 (see Figure 3) which controls the routing of data along the data 

15 path 22. In particular, as generally indicated by reference numeral 54, in one 
embodiment the routing controller 52 controls the routing of data to each 
processing module 12 to 20, 32, 34 via chip select lines 56 and address, write 
data, and write enable lines 58. Each module 12 to 20, 32, 34 communicates 
data to the routing controller 52 via read data and acknowledge lines 60. In 

20 one embodiment, the routing controller 52 defines a host interface that uses 
a full synchronous hand-shake approach that interfaces the various 
processing modules 12 to 20, 32, 34 of the device 30. For example, the 
routing controller 52 may generate a chip select that is held active until an 
acknowledge signal is received from a selected processing module 12 to 20, 

25 32, 34. In one embodiment, the routing controller 52 decodes the most 
significant bits of a host address and, in response thereto, generates a chip 
select that enables the selected processing module 12 to 20, 32, 34. As 
described in more detail below, each module 12 to 20, 32, 34 may locally 
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decode the remaining least significant bits of the hosts address that are 
significant thereby to identify the specific module 12 to 20, 32, 34 to which 
data is to be routed. 

[0016] The exemplary routing controller 52 of Figure 3 uses a common 
5 data bus 58 to provide address, write data and write enable data to all of the 
processing modules 12 to 20, 32, 34. However, each module 12 to 20, 32, 34 
includes a dedicated read data and acknowledge bus 60 for reading data and 
providing acknowledgements to the routing controller 52. 

[0017] In one embodiment of the invention, the DSP module 12 is 
10 interfaced to the routing controller 52 in such a fashion so that the DSP 
module 12 has access to registers and random access memory (RAM) 
provided in each of the modules 14 to 20, 32, 34. In particular, as shown in 
Figure 4, the DSP module 12 may communicate with the routing controller 
52 via a data bus 62, an address bus 64, acknowledge lines 66, write enable 
15 lines 68, a request line 70 and a chip select line 72. In order to access 

registers and RAM that may be provided in the modules 14 to 20, 32, 34, the 
DSP module 12 communicates a request via line 70 to the routing controller 
52. The routing controller 52 may then acknowledge the request via the 
acknowledge line 66 where after the requested functionality may be 
20 executed using the address bus 64 and data bus 62. 

[0018] In embodiments in which a sample rate tracker is provided within 
the digital audio I/O module 34, it may also be interfaced to the routing 
controller 52 thereby providing access to registers and/or RAM in the 
modules 12 to 20, 32. In one embodiment, the routing controller 52 treats 
25 requests from the DSP module 12 (and one or more sample rate trackers if 
provided) as equivalent to host processor accesses using a first come first 
served priority scheme. However, if the requests arrive at the same time, the 
requests may be sorted. For example, the routing controller 52 may first 
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route requests to the DSP module 12, then to the sample rate trackers 
provided in the digital audio I/O module 34 and, finally, to a host processor. 
In one embodiment, the device 30 has two base address registers, one 
mapped to I/O and the other mapped to memory. Both of these registers 
5 may be active simultaneously and, both address registers may allow access 
to the same internal registers and memories of a chip on which the device 30 
is provided. 

[0019] In one embodiment of the invention, the audio bus 46 provides 
audio channels that are time division multiplexed. Each processing module 
10 12 to 20, 32, 34 may have a fixed output time-slot allocated to it and a 
programmable or variable input time-slot. Thus, in this embodiment, the 
modules 12 to 20, 32, 34 may always output data in the same predetermined 
time-slot to the audio bus 46 but receive data in different time-slots under 
control of the routing controller 52. Thus, as the input time-slot associated 
15 with each individual module 12 to 20, 32, 34 is programmable, data may be 
routed between the various modules 12 to 20, 32, 34 in a flexible fashion. As 
described in more detail below, a channel identification bus may be 
provided to identify the module 12 to 20, 32, 34 with which the time-slot is 
associated. In one embodiment, the channel identification bus identifies a 
20 source processing module 12 to 20, 32,34 and a target or destination 

processing module 12 to 20, 32, 34 includes a list to identify data sources 
from which data is to be processed. However, it will be appreciated that the 
channel identification may also identify a target processing module 12 to 20, 
32, 34. 

25 10020] In certain embodiments, the device 30 allows digital data (e.g., 
digital audio data) to be communicated along the audio bus 46 at differing 
sample rates (e.g., sample rates set by the DSP module 12). For example, in 
one embodiment of the invention, 4096 buffer channels or time-slots are 
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provided on the audio bus 46. In this exemplary configuration, the audio 
bus 46 may then support sample rates of up to 384 kHz by allocating one 
time-slot for 48 kHz, two time-slots for 96 kHz, four time-slots for 192 kHz, 
and eight time-slots for 384 kHz. Thus, since there are 4096 total channels or 
5 time-slots in the given sample, only 2048 channels or time-slots are available 
at 96 kHz, 1024 time-slots available at 192 kHz, and 512 time-slots are 
available at 384 kHz. It is, however, to be appreciated that the number of 
time-slots for each sample rate at any given time during operation of the 
device 30 may vary and, for example, situations could arise where, for 

10 example, 3348 48 kHz time-slots are provided, 204 96 kHz time-slots are 

provided, and 85 192 kHz time-slots may be provided. However, the various 
configurations (e.g., bit-rates) or numbers of time-slots may vary depending 
upon the functionality to be executed by the device 30. For example, in other 
embodiments programmable operating clock frequencies may be provided. 

15 For example, clock frequencies of 150 MHz, 175 MHz, and 200 MHz may be 
provided that correspond to 3072, 3584, and 4096 time-slots respectively. It 
is, however, to be appreciated that these are merely examples of frequencies 
and time-slots and that they may change from embodiment to embodiment. 
Thus, in one embodiment, the media data path may include a total number 

20 of time-slots for communicating media data at a plurality of different bit 
rates wherein the sum of a number of time-slots allocated to each one of the 
plurality of bit rates equals the total number of time-slots. 

10021] In certain embodiments, arbitrary sample rates, such as the CD 
standard of 44.1 kHz, may be communicated or routed via the audio bus 46 

25 using a indicator bit (e.g. a valid bit) that indicates to a receiving module 12 
to 20, 32, 34 that a new valid sample is to be retrieved or extracted from the 
audio bus 46 for processing. When an arbitrary sample rate (such as the 44.1 
kHz sample rate) is communicated via the audio bus 46, and the exemplary 
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valid bit is high, the respective module 12 to 20, 32, 34 may accept the data 
as valid. Whereas, when the valid bit goes low, the module 12 to 20, 32, 34 is 
thereby informed that the subsequent samples may be disregarded. 

[0022] Although in one embodiment variable sample rates may be 
communicated via the audio bus 46, the parameter bus 48 may communicate 
control data at a fixed sample rate (e.g. 48 kHz) that may be independent of 
the sample rate of the audio bus 46. 

[0023] In one embodiment, the audio bus 46 communicates audio data to 
be processed by the various modules 12 to 20, 32, 34. However, the 
parameter bus 48 includes parameter or processing data which is used by an 
associated module 12 to 20, 32, 34 to define the functionality (e.g., algorithm) 
of the associated module 12 to 20, 32, 34. Accordingly, the control data may 
thus control how the data on the audio bus 46 will be processed by the 
particular module 12 to 20, 32, 34. For example, the parameter bus 48 may 
be used to communicate filter parameters to the filter module 18, sample 
rate conversion parameters to the sample rate converter module 16, delay 
data to the module 14 that defines the period by which the digital audio will 
be delayed, and so on. It will thus be appreciated that, in order to reduce 
any processing latencies in the device 30, the parameter data should be 
provided to each of the processing modules 12 to 20, 32, 34 prior to the time 
slot which each particular processing module 12 to 20, 32, 34 is to output 
processed audio data. Accordingly, as described in more detail below, 
parameter data is communicated via the parameter bus 48 to a particular 
processing module 12 to 20, 32, 34 prior to the audio data arriving at the 
processing module 12 to 20, 32, 34 via the audio bus 46. 

[0024] In one embodiment of the invention, audio data communicated 
via the audio bus 46 is in 32-bit IEEE floating-point format (single precision). 
Any module placed on the data path 22 that operates in a fixed-point format 
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(e.g., fixed-point audio) may thus be required to perform a conversion to 
and from floating-point format. As the fixed-point format is defined to be in 
a range of -1 to +1, any hardware conversion of the fixed-point format will 
saturate floating-point values that lie outside this range. Accordingly, the 
mixer module 20 may be used to scale any digital data that is placed on the 
data path 22 for any processing module that performs fixed-point 
conversion so that the conversion lies within the range of -1 to +1. For 
example, in one embodiment of the invention, the sample rate converter 
module 16 and the digital audio I/O module 34 may process data in a fixed- 
point format and, accordingly, scaling may then be required by the mixer 
module 20. 

[0025] Referring in particular to Figure 5, reference numeral 70 generally 
indicates an exemplary data path interface provided in each processing 
module 12 to 20, 32, 34. It will also be appreciated that the data path 
interface 70 may be provided in any further processing modules that may be 
added in a modular fashion to the device 30 to communicate via the data 
path 22. When the data path 22 includes a media data path in the form of 
the audio bus 46, a processing control path in the form of the parameter bus 
48, and a channel identification bus 49, the interface 70 may include input 
registers 72, 74, 76 which clock all inputs on the data path 22 into the 
respective processing module 12 to 20, 32, 34 for processing. In a similar 
fashion, output registers 78, 80, 82 clock data back onto the data path 22. 
Dedicated processing logic 84 is provided in each processing module 12 to 
20, 32, 34 to process the digital data, received via the audio bus 46, in 
accordance with the parameters received via the parameter bus 48. The 
functionality of the processing logic 84 differs from module to module. For 
example, the processing logic in the filter module 18 may define a plurality 
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of filters (e.g., IIR and FIR filters), the processing logic 84 in the sample rate 
converter module 16 may define a sample rate converter^ and so on. 

[0026] In the embodiment depicted in the drawings, the channel 
identification data included in the channel identification bus 49, and the 
parameter data provided by the parameter bus 48, is read by the processing 
logic 84 as shown by lines 86 and passed on or returned to the channel 
identification bus 49 and the parameter bus 48, respectively, two clock cycles 
later (as shown by lines 88). However, audio data provided by the audio 
bus 46 may be either passed directly on to the audio bus 46 (as shown by 
lines 90, 92) or be replaced with processed audio data from the processing 
logic 84 (as shown by lines 94 and 92). Accordingly, the data path interface 
70 may include a multiplexer 96 that selects between the data received via 
the audio bus 46 and the processed data received from the processes logic 
84. Thus, when a particular processing module 12 to 20, 32, 34 is not the 
target processing module 12 to 20, 32, 34 and it receives data, the processing 
module 12 to 20, 32, 34 may merely pass the data along the communicating 
ring to the next processing module 12 to 20, 32, 34. Accordingly, the data 
may be passed on sequentially until it reaches the target processing module 
12 to 20, 32, 34. It will be appreciated that the data passed along may form 
part of a stream of media data that is being processed. Likewise, streams of 
processing control data may be passed along the parameter bus 48. 

[0027] Referring in particular to Figure 6, an exemplary configuration of 
the data path 22 is shown. As mentioned above, in one embodiment, the 
data path 22 includes the audio bus 46, the parameter bus 48, and the 
channel identification bus 49. The channel identification bus 49 may include 
channel identifiers that identify both the channels or time-slots provided on 
the parameter bus 48 and the channels or time-slots provided on the audio 
bus 46. However, it is to be appreciated, that separate channel identifiers 
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may be provided for the audio bus 46 and the parameter bus 48. For 
example, embodiments may be provided wherein the audio bus 46 and the 
parameter bus 48 each have their own channel identification bus. In one 
embodiment of the invention, each channel identifier is in the form of a 
hexadecimal number generated by a counter which has its count included in 
the channel identification bus 49. 

[0028] Exemplary parameter definitions provided on the parameter bus 
48 (see Figure 6) are as follows: 

F, = filter parameters 0 to 4 for the filter module 18; 

Pitch = pitch of the sample rate converter module 16; 

GPP = general purpose parameters to be used by the modules 12 to 
20, 32, 34; and 

Taddr = delay line address of the delay module 14. 

[0029] Exemplary audio channel or time-slot definitions are as follows: 

FILT = outputs from the filter module 18 (e.g., of an I1R filter); 

DSP = outputs of the DSP module 12; 

SRC = outputs of the sample rate converter module 16; 

SUM = summation node outputs of the mixer module 20; 
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DAI = digital audio inputs from the I/O module 34; and 

Tank = data outputs from the delay module 14. 

[0030] In one embodiment of the invention, as mentioned above, the least 
significant two, three, or four bits of the channel identification data may be 
used to identify the specific processing module 12 to 20, 32, 34 associated 
with a particular time-slot and, accordingly thus identify the particular time- 
slot (or time-slots) that the processing module 12 to 20, 32, 34 owns. 
However, the most significant bits may be used to identify a logical channel 
or time-slot within the particular processing module. For example, a filter 
module that can process 512 discrete channels of audio implements a 
plurality of 512 discrete filter channels, each requiring its own set of filter 
parameters, and each providing its own discrete filtered audio output. In an 
embodiment of the invention that contains such a filter module, the most 
significant 9 bits of the channel identification data may determine to which 
filter channel the filter parameters belong, and which filter channel 
generated the audio. 

[0031] In one embodiment of the invention, the channel identification 
data provided via the channel identification bus 49 is generated in the mixer 
module 20. As mentioned above, the channel identification data may define 
a channel identifier that may be generated by a counter that runs from 0 to 
4095 wherein each number identifies, or is associated with, a particular 
channel or time-slot. Further, as mentioned above, in order to ensure that * 
parameters arrive at the appropriate processing module 12 to 20, 32, 34 prior 
to the time-slot in which they are to output processed audio data, the data 
on the parameter bus 48 may be offset relative to data provided on the audio 
bus 46. 
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[0032] In one embodiment of the invention, software may program the 
mixer module 20. The software may then take into account that a module 12 
to 20, 32, 34 requires a certain amount of time to operate on incoming 
parameters (via the parameter bus 48) and to generate the processed audio 
data which it then outputs on the audio bus 46. In these embodiments, the 
appropriate parameters for the processing module 12 to 20, 32, 34 are 
provided in a time-slot that precedes the time-slot in which the module 
outputs the audio data on audio bus 46. As different processing modules 12 
to 20, 32, 34 may require different parameters and times to process the 
parameters and audio, parameters associated with different processing 
modules 12 to 20, 32, 34 may be offset by a differing number of time-slots. 
For example, an exemplary offset of 96 may be provided for the sample rate 
converter module 16, an exemplary parameter offset of 40 may be provided 
for the filter module 18, and an exemplary parameter offset of 20 may be 
provided to the delay module 14. It is, however, to be appreciated that the 
offsets may differ from embodiment to embodiment and also differ in a 
single embodiment depending on the functionality or algorithm that the 
modules 12 to 20, 32, 34 are to perform or execute. 

[0033] In certain embodiments, it is necessary to buffer the audio data 
received via the audio bus 46. In particular, phase coherency is a 
requirement for multi-channel audio data to avoid phase cancellation and 
image shifting. Phase coherency is simplified by buffering a full sample 
period of audio data. A processing module may then process guaranteed 
phase coherent audio from its local audio buffer without respect to the 
relative intra-sample timing of data arrival and data processing. It may not 
be necessary to buffer all channels received via audio bus 46, only those that 
are to be processed. To implement phase coherency, a ping-pong buffer 
scheme can be used in which at least two buffers, "A" and B", alternate in 
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usage from write to read. During the first sample period, the received audio 
data may be written to buffer "A" while the processing module reads from 
buffer "B". At a certain time, the buffers may swap functions so that during 
the next sample period, the received audio data is written to buffer "B" 
while the processing module reads from buffer "A". In certain 
embodiments, the delay module 14, the filter module 18, and the mixer 
module 20 may change or swap audio buffers synchronized with their 
respective channel processing times. For example, data path or audio ring 
input buffers of the delay module 14 may swap when the delay module 14 
channel equals zero, e.g., when the delay module 14 begins to generate the 
audio it will output to the audio bus 46 when the most significant bits of the 
channel identification are equal to zero. This may occur when the data path 
or audio ring channel or time-slot equals the maximum channel 
identification minus the parameter offset of the delay module 14. If the 
parameter offset is equal to 20, this delays the last 20 audio ring channels or 
time-slots by an extra sample period relative to the other ring channels or 
time-slots from the perspective of the delay module 14, Likewise, in the case 
of the filter module 18, the last 40 audio ring channels or time-slots maybe 
delayed by an extra sample period to the filter module 18. In certain 
embodiments, the mixer module 20 may delay the last 18 audio ring 
channels or time-slots. However, in one embodiment, the sample rate 
converter module 16 may write audio ring data directly into its channel 
caches and, accordingly, relative delay problems may not be experienced. 

[0034] As mentioned above, output time-slots (time-slots in which each 
processing module 12 to 20, 32, 34 outputs data onto the audio bus 46) are 
dedicated time-slots. However, in certain embodiments, the time-slots in 
which data is communicated to any one of the processing modules 12 to 20, 
32, 34 is programmable and, thus, the channel identification data identifies 
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the particular processing module 12 to 20, 32, 34 that is to process the audio 
data on the audio bus 46. In one embodiment, the parameter bus 48 has its 
input time-slots allocated. Further, in certain embodiments, the mixer 
module 20 may provide the parameters that are communicated to the 
various processing modules 12 to 20, 32, 34 via the parameter bus 48. 
Accordingly, not only can data be flexibly routed from any one of the 
processing modules 12 to 20, 32, 34 to any other one or more processing 
modules 12 to 20, 32, 34 but, in a similar fashion, parameters may be flexibly 
routed to any of the processing modules 12 to 20, 32, 34. In one embodiment 
of the invention, the DSP module 12 can overwrite parameters on the 
parameters bus 48 thereby allowing the DSP module 12 direct control of the 
functionality executed or performed by the delay module 14, the sample rate 
converter module 16, the filter module 18, and the mixer module 20 (or any 
other modules added to the data path 22). 

(0035] As mentioned above, data included in the audio bus 46 and 
parameters included in the parameter bus 48 may be flexibly routed to the 
processing modules 12 to 20, 32, 34. In one embodiment of the invention, an 
input mapper in the form of a linked list 100 (see Figure 7) is provided. In 
this embodiment, the routing controller 52 (see Figure 3) performs 
programmable input mapping to flexibly route audio data to the various 
processing modules 12 to 20, 32, 34. In use, the input mapper may traverse a 
linked list 100 of input channel identifiers 102 and input RAM addresses 104 
to determine which input channels are written to which addresses within the 
input audio buffer. In one embodiment of the invention, the linked list 100 
is used and the list is arranged or sorted in an order of ascending channel 
identifiers regardless of the input audio buffer address, as shown by arrows 
106. A host software driver may maintain the list 100. 
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[0036] The input mapper may, in use, load the first element in the linked 
list 100 which may include the input channel identifier 102, the input audio 
buffer address 104 and appoint it to the next element in the list. The input 
mapper then waits until the input channel identifier on the channel 
identification bus 49 matches the input channel identification field 102 and 
then writes the input audio data received via audio bus 46 to the designated 
input audio buffer address. The element of the linked list 100 designated by 
the next linked list address field 101 may then be loaded and the operation 
may be repeated. The linked list 100 may be maintained in a circular fashion 
so its last element points to its first element of the linked list 100. On reset, 
for example, a default input mapping list may be automatically written by 
hardware initialization logic and host driver software may merely be 
required to maintain the linked list 100. If multiple filters are provided by 
the filter module 18, an additional level of mapping may be provided to 
support multiple filters operating on the same input signal or data provided 
via the audio bus 46. 

[0037] The methodology described above is broadly summarized in 
Figure 8 of the drawings. Reference numeral 110 generally indicates a 
method of communicating digital media data (e.g., digital audio data) in a 
digital media processing device such as a digital audio processing device. As 
shown at block 112, digital data is provided on the data path 22. Each 
particular processor module 12 to 20, 32, 34 then identifies if the data is 
associated with the particular processor module 12 to 20, 32, 34 (see block 
114). The digital data provided on the data path 22 in block 112 may include 
both digital audio data provided on the audio bus 46 and/or process control 
data (e.g. parameter data) provided on the parameter bus 48. 

[0038] As shown at decision block 116, if data on the data path 22 is not 
associated with the particular processing module 12 to 20, 32, 34, then the 
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data received by the particular module 12 to 20, 32, 34 is merely passed 
along the data path 22. If, however, the data is associated with the particular 
module 12 to 20, 32, 34 (e.g. the routing controller 52 has identified that the 
data is to be routed to the particular processing module 12 to 20, 32, 34), the 
data (audio data and /or parameter data as the case may be) is extracted 
from the data path 22 (see block 118). When the extracted data is parameter 
data, the processing module 12 to 20, 32, 34 uses this data to define the 
functionality (e.g. algorithm) that it is to execute. When the audio data 
subsequently arrives, the processing module 12 to 20 processes the audio 
data to generate processed data (see block 120) that is then provided to the 
data path 22. Thereafter, the method 110 repeats its monitoring functionality 
as described herein. It is to be appreciated that any of the methodologies 
described herein may be provided on any machine-readable medium. 
Accordingly, the invention extends to a machine-readable medium 
embodying a sequence of instructions, that when executed by a machine, 
cause the machine to execute the functionality described herein. 

[0039] In one embodiment of the invention, the digital processing device 
30 is in the form of a VLSI chip. The DSP module 12 may be a 32-bit 
fixed /floating point DSP that executes four interleaved threads 
simultaneously. The device 30 may, for example, include one or more of the 
following: 

. 200 MHz internal clock; 

. threaded interleaved architecture DSP with 1200 MFLOPS; 
. the DSP may dedicate independent DMA controllers to access 

host memory /SD RAM; 
• the delay module 14 may support fractional delay lengths and 

1024 memory accesses; 
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• the mixer module 20 may be a 4096 channel floating-point audio 
mixer; 

• a 5632 channel self ramping parameter generator may be 
provided; 

• the sample rate converter module 16 may be a 256 channel, hybrid 
sample rate converter; 

• the filter module 18 may be a 512 channel second order digital 
filter; 

• the interface module 38 may be a PCI-X interface for interfacing 
the device 30 to 100 MHz SD RAM interfaces; 

• four stereo I 2 S digital inputs may be provided; 

• four stereo I 2 S digital outputs may be provided; 

• four stereo S/PDIF inputs configurable as eight channel C/ DIF 
inputs may be provided; 

• four stereo S/PDIF outputs configurable as eight channel C/DIF 
outputs may be provided; 

. PLL slave capability to I'S and S/PDIF or C/DIF inputs may be 
provided; 

• 16 independent configurable general purpose input output pins 
may be provided on the chip; and 

• EPROM interfaces for overwriting reset defaults may be provided. 

[0040] In one embodiment, the device 30 may be connected to a general 
purpose microprocessor either through the interface module 38 or through 
an embedded microprocessor bus interface. The microprocessor may control 
the device 30, for example, through the routing controller 52 which, 
accordingly, may define a host interface. External SD RAM connected to the 
audio memory transport module 32 may be provided in certain 
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embodiments. In one embodiment, the audio bus 46 may be sample locked 
at 48 kHz to each processing module 12 to 20, 32, 34. In one embodiment, 
the audio bus 46 provides 256 dedicated 32-bit input channels and, 
accordingly, the data path interface 70 may include 256 32-bit input channels 
and 256 32-bit output channels. As mentioned above, the output channels 
may be predefined or dedicated and the input channels may be 
programmable. As mentioned above, the device 30 may include a linked list 
100 and, in one embodiment, the DSP module 12 includes 256 input channels 
that are mapped to the 4096 channels of the audio bus 46 using the linked 
list 100. In one embodiment, whenever the DSP module 12 writes to an 
audio output channel of the audio bus 46 in a given sample period, the 
audio data written is transferred to the audio bus 46 and an audio ring valid 
bit may then be set for the particular channel during the next sample period, 
The parameter bus 48 may provide 256 32-bit input/output channels for 
parameter passing or routing. 

[0041] In one embodiment, any input channel or time-slot of the audio 
bus 46 (regardless of whether it is data used by other modules on the audio 
bus 46) may be available for use as a sample-locked 32-bit inter-thread data 
channel visible to all processing modules 12 to 20, 32, 34. This may provide 
a primary mechanism to the device 30 for passing data between time 
domain DSP threads located in different processor modules 12 to 20, 32, 34. 
When an unused output buffer channel or time-slot is used for inter-thread 
data passing, the passed data may appear as valid on the audio bus 46 in the 
time-slot allocated for the particular output buffer channel or time-slot. 

[0042] Data written to an available input or output audio bus buffer for 
inter-thread data passing may be immediately visible to all other threads for 
the remainder of the sample period in which it was written. 
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[0043] Thus, method and device to process digital media streams have 
been described. Although the present invention has been described with 
reference to specific exemplary embodiments, it will be evident that various 
modifications and changes may be made to these embodiments without 
departing from the broader spirit and scope of the invention. Accordingly, 
the specification and drawings are to be regarded in an illustrative rather 
than a restrictive sense. 

[0044] In preferred embodiments, there is provided a digital processing 
device to process media data is provided. The device includes a plurality of 
processing modules to process the media data, and a media data path. The 
media data path communicates the media data between the processing 
modules, wherein the media data path is arranged in a ring configuration. 
In one embodiment, the media data path defines a digital audio bus that 
serially interconnects the plurality of processing modules. The digital audio 
bus may communicate digital audio data in a plurality of time-slots, each 
particular processing module having an associated time-slot from which 
data is received from the data path for processing by the particular 
processing module. 

[0045] Each feature disclosed in the description and (where appropriate) 
the claims and drawings may be provided independently or in any 
appropriate combination. 
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CLAIMS 



1 . A digital processing device to process media data, the device 
including: 

5 a plurality of processing modules to process the media data; and 

a data path to communicate data between the processing modules, 
wherein the data path is arranged in a ring configuration. 

2. The device of claim 1, wherein the data path defines a media data 

10 path including a digital audio bus that serially interconnects the plurality of 
processing modules. 

3. The device of claim 2, wherein the digital audio bus communicates 
digital audio data in a plurality of time-slots, each particular processing 

15 module having at least one programmable or fixed time-slot from which 
data is received from the data path for processing by the particular 
processing module. 

4. The device according to claim 2 or 3, wherein the digital audio bus 
20 communicates digital audio data in a plurality of time-slots, each particular 

processing module being assigned at least one time-slot into which data 
processed by the particular processing module is exported to the digital 
audio bus 

25 5. The device according to any of the preceding claims, wherein one of 
the processing modules is a Digital Signal Processor (DSP) and the data path 
communicates processing control data in a plurality of time-slots that are 
allocated to the processing modules under control of the DSP. 
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6. The device according to any of the preceding claims, wherein the data 
path is a time division multiplexed bus including a plurality of audio 
channels. 

5 

7. The device according to any of the preceding claims, wherein the data 
path communicates data between the plurality of processing modules at bit 
rates that differ. 

10 8. The device according to any of the preceding claims, wherein the data 
path defines a media data path which includes a total number of time-slots 
for communicating media data at a plurality of different bit rates, and 
wherein the sum of a number of time-slots allocated to each one of the 
plurality of bit rates equals the total number of time-slots. 

15 

9. The device according to any of the preceding claims, wherein each 
processing module: 

selectively extracts media data for processing from the data path, the 
media data being provided in at least one time-slot of the data path allocated 
20 to the processing module; 

selectively inserts processed media data into its allocated time-slot; 

and 

passes media data that it receives and that is associated with other 
processing devices unchanged along the data path. 

25 

10. The device according to any of the preceding claims, wherein the 
number of processing modules connected along the data path is 
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configurable, each processing module included in the device being allocated 
at least one time-slot provided by the data path. 

11. The device according to any of the preceding claims, wherein the data 
path includes a control data path to communicate processing control data to 
at least one processing module, the processing control data being used by 
the processing module to process digital data received from the data path. 

12. The device of claim 11, wherein the processing control data includes 
parameters for digital signal processing by the processing module. 

13. The device of claim 12, wherein the parameters include at least one of 
filter parameters, time delay parameters, mixing parameters, and sample- 
rate conversion parameters. 

14. The device according to any of claims 11 to 13, wherein the 
processing control path is a time division multiplexed bus arranged in a ring 
configuration. 

15. The device according to any of claims 1 1 to 14, wherein the 
processing control data includes streams of processing control data each of 
which is associated with a stream of media data communicated via the data 
path, each stream of processing control data being destined for an associated 
target processing module to which the stream of media data is 
communicated. 

16. The device of claim 15, wherein each stream of processing control 
data is arranged to be communicated via the control data path to arrive at its 
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associated target processing module prior to a source processing module 
exporting the media data to the media data path. 

17. The device according to any of the preceding claims, wherein the data 
5 path includes: 

a plurality of media channels defined by time division multiplexed 
time-slots; and 

a channel identification path including channel identification data to 
identify each media channel to the processing modules. 

10 

18. The device of claim 17, wherein the data path includes a control data 
path to communicate processing control data to at least one processing 
module, the control data path including a plurality of control channels 
defined by time division multiplexed time-slots, wherein the channel 

15 identification path identifies both the media channels and the control 
channels. 

19. The device according to any of the preceding claims, wherein the data 
path includes a transport bus to communicate data between an external 

20 memory and at least one of the plurality of processing modules. 

20. The device according to any of the preceding claims, wherein the 
processing modules are digital audio processing modules selected from the 
group consisting of an audio memory transport module, a digital delay line 

25 module, a sample rate converter module, a filter module, a mixer module, a 
DSP module, and a digital Input/Output module. 
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21. The device according to any of the preceding claims, wherein the data 
path and the processing modules are provided in a very large scale 
integration (VLSI) device. 

5 22. A digital processing device to process media data, the device 
including: 

a plurality of processing modules to process the media data; 

a media data path to communicate the media data between the 
processing modules; 
10 a processing control data path to communicate processing control 

data between the processing modules, wherein the processing control data 
defines processing functionality at an associated processing module; and 

a routing controller to route the media data and the processing 
control data to an associated processing module. 

15 

23. The device of claim 22, wherein the media data path and the 
processing control path are arranged in a ring configuration. 

24. A method to communicate media data between a plurality of 
20 processing modules in a digital media processing device, the method 

including: 

providing the media data to a data path at a source processing 
module, the data path interconnecting the plurality of processing modules; 
extracting the media data at a target processing module of the 
25 plurality of processing modules; and 

providing processed media data to the data path for communication 
to another target processing module. 
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25. The method of claim 24, which includes communicating the media 
data sequentially between the plurality of processing modules. 

26. The method according to claims 24 to 25, wherein the data path 
includes a processing module identifier that identifies the source processing 
module that provides the media to the data path. 

27. The method according to any of claims 24 to 26, which includes 
passing on media data received at a particular processing module to another 
processing module when the processing module receiving the media data is 
not the target processing module. 

28. The method according to any of claims 24 to 27, wherein the data 
path includes a plurality of time-slots, the method including providing the 
processed media data into a rime-slot associated with a source processing 
module. 

29. The method according to any of claims 24 to 28, wherein the data 
path includes a digital media path and a processing control path, the method 
including: 

providing the media data in the form of audio data to the digital 
media path; and 

providing processing control data to the processing control data path, 
the processing control data controlling the processing of the audio data by 
the target processing module. 

30. The method according to any of claims 24 to 29, which includes 
providing the media data in at least one time-slot of a digital audio bus 
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defined by the data path, each particular processing module having at least 
one programmable or fixed time-slot from which data is received from the 
digital audio bus for processing by the particular processing module. 

5 31 . The method according to any of claims 24 to 30, which includes 
assigning each particular processing module at least one time-slot of a 
digital audio bus defined by the data path, wherein digital audio data 
processed by the particular processing module is exported to the time-slot. 

10 32. The method according to any of claims 24 to 31, wherein one of the 
processing modules is a Digital Signal Processor (DSP), the method 
including communicating processing control data via the data path in a 
plurality of time-slots that are allocated to the processing modules under 
control of the DSP. 

15 

33. The method according to any of claims 24 to 32, wherein the data 
path is a time division multiplexed bus including a plurality of audio 
channels. 

20 34. The method according to any of claims 24 to 33, which includes 

communicating data between the plurality of processing modules at bit rates 
that differ. 

35. The method according to any of claims 24 to 34, wherein the data 
25 path includes a total number of time-slots for communicating media data at 
a plurality of different bit rates, the method including allocating a number of 
time-slots to each one of the plurality of bit rates so that a sum of the number 



30 



of slots allocated to the plurality of bit rates equals the total number of time- 
slots. 

36. The method according to any of claims 24 to 35, wherein the number 
of processing modules connected along the data path is configurable, the 
method including allocating at least one time-slot provided by the data path 
to each processing module. 

37. The method according to any of claims 24 to 36, which includes 
communicating processing control data to at least one target processing 
module via a control data path, the processing control data being used by 
the target processing module to process digital data received from a media 
data path. 

38. The method of claim 37, which includes processing the media data 
using the processing control data that includes parameters for digital signal 
processing. 

39. The method of claim 38, which includes communicating parameters 
including at least one of filter parameters, time delay parameters, mixing 
parameters, and sample-rate conversion parameters to a processing module 
via the control data path. 

40. The method according to any of claims 37 to 39, which includes 
communicating the processing control data in a time division multiplexed 
fashion. 
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41. The method according to any of claims 37 to 40, wherein the 
processing control data includes streams of processing control data each of 
which is associated with a stream of media data communicated via the 
media data path, each stream of processing control data being destined for 
an associated target processing module to which the stream of media data is 
communicated. 

42. The method of claim 41, which includes communicating each stream 
of processing control data via the control data path to arrive at its target 
processing module prior to exporting the media data from its source 
processing module to the media data path. 

43. The method according to any of claims 24 to 42, wherein the data 
path includes: 

a plurality of media channels defined by time division multiplexed 
time-slots; and 

a channel identification path including channel identification data to 
identify each media channel to the processing modules. 

44. The method of claim 43, which includes communicating processing 
control data to at least one target processing module via a control data path, 
the control data path including a plurality of control channels defined by 
time division multiplexed time-slots, wherein the channel identification path 
identifies both the media channels and the control channels. 

45. The method according to any of claims 24 to 44, which includes 
communicating data between an external memory and at least one of the 
plurality of processor modules via a transport bus. 
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46. The method according to any of claims 24 to 45, which includes 
communicating media data between digital audio processing modules 
selected from the group consisting of an audio memory transport module, a 
digital delay line module, a sample rate converter module, a filter module, a 
mixer module, a DSP module, and a digital Input/Output module. 

47. A machine-readable medium embodying a sequence of instructions 
that, when executed by the machine, cause the machine to: 

provide media data to a data path at a source processing module, the 
data path interconnecting a plurality of processing modules; 

extract the media data at a target processing module of the plurality 
of processing modules; and 

provide processed media data to the data path for communication to 
another target processing module. 

48. The machine-readable medium of claim 47, wherein the media data is 
communicated sequentially between the plurality of processing modules. 

49. The machine-readable medium according to any of claims 47 to 48, 
wherein the data path includes a processing module identifier that identifies 
the source processing module that provides the media to the data path. 

50. The machine-readable medium according to any of claims 47 to 49, 
wherein media data received at a particular processing module is passed on 
to another processing module when the processing module receiving the 
media data is not the target processing module. 
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51. The machine-readable medium according to any of claims 47 to 50, 
wherein the data path includes a plurality of time-slots and the processed 
media data is provided in a time-slot associated with a source processing 
module. 

5 

52. The machine-readable medium according to any of claims 47 to 51, 
wherein the data path includes a digital media path and a processing control 
path, the instructions causing the machine to: 

provide the media data in the form of audio data to the digital media 
10 path; and 

provide processing control data to the processing control data path, 
the processing control data controlling the processing of the audio data by 
the target processing module. 

15 53. The machine-readable medium according to any of claims 47 to 52, 
wherein the media data is provided in at least one time-slot of a digital 
audio bus defined by the data path, each particular processing module 
having at least one programmable or fixed time-slot from which data is 
received from the digital audio bus for processing by the particular 

20 processing module. 

54. The machine-readable medium according to any of claims 47 to 53, 
wherein each particular processing module is assigned at least one time-slot 
of a digital audio bus defined by the data path, and wherein digital audio 
25 data processed by the particular processing module is exported to the 
programmable time-slot. 
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55. The machine-readable medium according to any of claims 47 to 54, 
wherein one of the processing modules is a Digital Signal Processor (DSP), 
and wherein processing control data is communicated via the data path in a 
plurality of time-slots that are allocated to the processing modules under 
control of the DSP. 

56. The machine-readable medium according to any of claims 47 to 55, 
wherein the data path is a time division multiplexed bus including a 
plurality of audio channels. 

57. The machine-readable medium according to any of claims 47 to 56, 
wherein data is communicated between the plurality of processing modules 
at bit rates that differ. 

58. The machine-readable medium according to any of claims 47 to 57, 
wherein the data path includes a total number of time-slots for 
communicating media data at a plurality of different bit rates, and wherein a 
number of time-slots are allocated to each one of the plurality of bit rates so 
that a sum of the number of time-slots allocated to each one of the plurality 
of bit rates equals the total number of time-slots. 

59. The machine-readable medium according to any of claims 47 to 58, 
wherein the number of processing modules connected along the data path is 
configurable and wherein at least one time-slot is provided by the data path 
to each processing module. 

60. The machine-readable medium according to any of claims 47 to 59, 
wherein processing control data is communicated to at least one target 
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processing module via a control data path, the processing control data being 
used by the target processing module to process digital data received from a 
media data path. 

61. The machine-readable medium of claim 60, wherein the media data is 
processed using the processing control data that includes parameters for 
digital signal processing. 

62. The machine-readable medium of claim 61, wherein parameters 
including at least one of filter parameters, time delay parameters, mixing 
parameters, and sample rate conversion parameters are communicated to a 
processing module via the control data path. 

63. The machine-readable medium according to any of claims 60 to 62, 
wherein the processing control data is communicated in a time division 
multiplexed fashion. 

64. The machine-readable medium according to any of claims 60 to 63, 
wherein the processing control data includes streams of processing control 
data each of which is associated with a stream of media data communicated 
via the media data path, each stream of processing control data being 
destined for an associated target processing module to which the stream of 
media data is communicated. 

65. The machine-readable medium of claim 64, which includes 
communicating each stream or thread of processing control data via the 
control data path to arrive at its target processing module prior to exporting 
the media data from its source processing module to the media data path. 
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66. The machine-readable medium according to any of claims 47 to 65, 
wherein the data path includes: 

a plurality of media channels defined by time division multiplexed 
5 time-slots; and 

a channel identification path including channel identification data to 
identify each media channel to the processing modules. 

67. The machine-readable medium of claim 66, wherein processing 

1 0 control data is communicated to at least one target processing module via a 
control data path, the control data path including a plurality of control 
channels defined by time division multiplexed rime-slots, wherein the 
channel identification path identifies both the media channels and the 
control channels. 

15 

68. The machine-readable medium according to any of claims 47 to 67, 
wherein data is communicated between an external memory and at least one 
of the plurality of processor modules via a transport bus. 

20 69. The machine-readable medium according to any of claims 47 to 68, 
media data is communicated between digital audio processing modules 
selected from the group consisting of an audio memory transport module, a 
digital delay line module, a sample rate converter module, a filter module, a 
mixer module, a DSP module, and a digital Input/ Output module. 

25 

70. A digital processing device, substantially as herein described and as 
illustrated in the accompanying drawings. 
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71. A method to communicate media data, substantially as herein 
described and as illustrated in the accompanying drawings. 

72. A machine-readable medium, substantially as herein described and as 
illustrated in the accompanying drawings. 

5 
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